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Abstract 

We study a concept in multicriteria optimization called compromise solutions (introduced 

■ in 1973 by Yu [20]) and a generalized version of this, termed reference point solutions. Our 
, main result shows the power of this concept: Approximating reference point solutions is 

■ polynomially equivalent to constructing an approximate Pareto set as in [16]. 

^ . A reference point solution is the solution closest to a given reference point in the objective 

' ' ■ space. Compromise solutions use the component-wise minimum over all solutions as a 

CO . reference point. These methods are widely spread in practice. While for a fixed norm it 

■ gives a single solution balancing the different criteria, by changing the norm in the objective 
space each point in the Pareto set can become the reference point solution, thus maintaining 

■ the full variability of multicriteria problems. Despite its apparent virtues only few theoretical 
, and even less algorithmic results are known for reference point methods. 

^ ■ We study minimization problems with a constant number of criteria. In addition to the 

Q . equivalence of approximability of reference point solutions and the Pareto set, our techniques 

allow us to show that the Pareto set has a constant factor approximation if and only if the 
I , single-criterion problem has a constant factor approximation. We further give several general 

^ ■ techniques to obtain solutions for reference point methods. The main algorithmic result is 

l/^ , an LP-rounding technique that achieves the same approximation factors for reference point 

■ solutions as in the single-criterion case for many classical combinatorial problems, including 
"J , set-cover and several machine scheduling problems. By the established link our algorithmic 

results also give a short alternative proof for the existence of an FPTAS of the Pareto set 
in the case of linear optimization over convex sets [16]. 

O. 

(N. 

! 1 Introduction 
>■ 

^ ■ In many applications of combinatorial optimization, trade-offs between conflicting objectives 

^ ! play a crucial role. For example, route guidance systems are a classical application of the 

■ - - ■ shortest path problem. Yet, a good route guidance should allow the driver to make an informed 

choice to balance travel time and fuel consumption. 

It is well-known that even for this basic example, the bicriteria shortest path problem, the 
number of Pareto optimal (i.e., non-dominated) solutions can grow exponentially with the size 
of the network. Decision makers may have different preferences how much extra fuel to spend 
on less travel time. Thus, a central task of multicriteria optimization is to either find a single 
solution based on a priori expressed trade-off preferences of the decision maker, or to identify a 
set of solutions that is of manageable (in mathematical terms: polynomial) size but still reflects 
all possible trade-off options at least approximately. 

A straightforward way to a single solution is the weighted-sum method: The trade-off prefer- 
ences are specifled by two non-negative weights for time and fuel consumption. The navigation 
system then chooses a route minimizing the weighted sum of the two objectives. Unfortunately, 
this method deprives the decision maker of essential solutions: Consider an instance with three 



1 



possible routes with corresponding objective value vectors (10,1), (6,6), and (1,10), respec- 
tively. The route with fuel consumption 6 and travel time 6 will never be the optimum for any 
choice of weights, despite being a balanced and thus attractive alternative for many drivers. 

Formally, this shortcoming of the weighted-sum approach means that it cannot reach every 
point of the Pareto set. This motivates the concept of compromise solutions and reference point 
solutions [20], which returns a solution closest in the objective space to a given reference point. 
(Compromise solutions use the component-wise minimum over all solutions as a reference point.) 
The trade-off preferences are reflected by the choice of the norm in the objective space. Every 
point in the Pareto set is a reference point solution for some norm. Reference point methods 
are widely used in practice, serving as a core concept of MCDM^ tools (cf. [3, 15] for particular 
examples and [6] for an overview). Still, they did not attract a lot of theoretical interest so far. 

We show that approximating reference point solutions is computationally equivalent to ap- 
proximating the Pareto set as proposed in Papadimitriou and Yannakakis [16]. Further, we 
provide general techniques for approximation algorithms, by means of which reference point 
solutions can often be approximated with the same factor as the single-criterion problem, most 
notably for the case of LP-rounding. One byproduct are approximation algorithms for the 
Pareto sets of many hard combinatorial optimization problems. 

Related Work. Multicriteria optimization has a long tradition. The central notion of Pareto 
optimality goes back to publications by V. Pareto in the late 19th and early 20th century. Ever 
since then solution concepts in multicriteria optimization have been studied. The notion of 
compromise solutions was introduced in 1973 by Yu [20] and further studied and extended in 
the following years by Freimer and Yu [7], Gearhardt [8], Choo and Steuer [5] and many others. 
Recently, Voorneveld et al. [18] gave an axiomatization of compromise solutions, in particular 
those w.r.t. the Euclidean norm. The concept was later extended to more general reference 
points and is incorporated in many MCDM tools [3, 6, 15]. 

Also the approximation of Pareto sets has been studied for several decades now. It was 
initiated by Hansen in 1979 [11], followed by several publications on specific problems such as 
shortest paths [19] and scheduling [4]. More general results on the existence and computability 
of approximate Pareto sets were presented by Safer in his PhD thesis [17] in 1992, and in 2000 
by Papadimitriou and Yannakakis [16]. Some of our results are based on the latter. Recently 
Mittal and Schulz [13] have used approximate Pareto sets to approximately optimize low-rank 
functions over polytopes. Their concept is similar to reference point methods as both can be 
seen as an aggregation of multiple objectives into one. 

Multicriteria optimization and in particular compromise solutions are also closely related 
to robust optimization, in particular to min-max regret robustness. This connection has also 
been noted and exploited by others, e.g. Aissi et al. [1, 2]. We extend some of their results to 
reference point methods. 

Our Contribution. Due to space limitations, we restrict ourselves to minimization problems 
throughout this paper. We note that this is not without loss of generality and some of our 
results do not to hold in the context of maximization. 

In Section 3, we establish an algorithmic link between reference point solutions and ap- 
proximation of the Pareto set. As a main result we show that approximating the reference 
point solution, approximating the compromise solution, and approximating the Pareto set are 
polynomially equivalent. In this context, we also prove that any point in the Pareto set can be 
obtained as reference point solution for two classes of popular norms with polynomially sized 
norm parameters, extending a known result by Gearhardt [8]. 

Combining these results with an easy constant factor approximation for reference points 
yields the following interesting corollary: For any discrete minimization problem with a fixed 

^Multicriteria Decision Making 
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number of criteria there is a constant factor approximation for the Pareto set if and only if there 
is a constant factor approximation for the single-criterion version of the problem. 

In Section 4, we show how to solve the reference point problem approximately for many com- 
binatorial optimization problems. As a main result in this section, we show that single-objective 
approximations obtained by LP-rounding directly carry over to approximation algorithms for 
reference point methods. Along the way, we also prove that reference point solutions for linear 
objectives on convex sets can be found efficiently. From this we get a short alternative proof 
for the existence of an FPTAS for the Pareto set of such problems [16]. 

Finally, we extend a technique by Aissi et al. [1] from robust optimization to multicriteria 
optimization, allowing us to construct an FPTAS for reference point problems from pseudopoly- 
nomial algorithms. 

2 Preliminaries 

Throughout the paper, we let V denote a multicriteria discrete minimization problem with k 
objectives. As usual in multicriteria optimization, we assume the number of objectives to be 
fixed. For a given instance of V, the set of feasible solutions is denoted by X and c : A" — t- Z>q 
is the vector of objective functions. The objective vector set of the instance is defined by 
y := c{X) C Z>Q. A solution y € 3^ is Pareto optimal if there does not exist y' £ y\ {y} with 
y' < y. The Pareto set yp is the set of all Pareto optimal solutions. 

Reference Point Methods. The goal of reference point methods is to find a solution min- 
imizing the distance to a user-specified reference point y^^ G Z>q w.r.t. a given norm ||-||. 
A particularly interesting reference point is the ideal point y^'^ G ^>0' which is the point in 
the objective space obtained by optimizing each objective individually, i.e., y-'^ := miuy^yyi. 
Throughout this paper, we will restrict ourselves to reference points y^'P with y^'P < y"^. We call 
these points feasible reference points. 

Besides choosing the reference point, the decision maker can furthermore express her pref- 
erences by specifying weights. For any norm ||-|| on R'' and A G (Q^q, let \\-\\^ be the norm 
defined by := \\{Xiyi, ■ ■ ■ , \kyk)\\- We will consider the objective function ryip x{y) = 

||yrp||A _|_ ||y _ yrp||A^ which we call relative distance"^. Note that, for exact computation, min- 
imizing the relative distance is equivalent to minimizing the absolute distance ||y — y'^PH^, as 
the level sets of the two functions are the same. However, in the context of approximation, this 
change in the objective function plays a crucial role. From a practical point of view, a decision 
maker will care about the relative deviation from the ideal values. From a theoretical point of 
view, any approximation algorithm for the absolute distance can be turned into an algorithm 
that solves the single-criterion problem exactly (as the minimal distance to the ideal point is 0, 
when focusing on a single criterion) . As we do not want to restrict our study to exactly solvable 
problems, we will use the relative distance, which allows us to also consider problems that are 
only approximately solvable. 

We now formally define the problem RP('P, ||-||): Given an instance of "P, a feasible reference 
point y^^ G S>0) and a weight vector A G Q>o as input, find a solution x ^ X that minimizes 
ryip^\{c{x)). Given the particular interest of the ideal point, we will also consider the problem 
CP(P, ||-||), which is also known as compromise programming: Given an instance of V and 
A G Q>0) find a solution x G that minimizes ryid x[c{x)). 

Note that although the concept of reference point solutions is a generalization of compromise 
solutions, in terms of complexity CP is not a special case of RP. In the former problem, the 
ideal point is not given and might be hard to compute (in other words: we cannot even evaluate 

^The relative distance is not a distance in the mathematical sense of a metric. In particular the triangle 
inequality does not hold. 
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the objective function efficiently), while in the latter case, the reference point is given in the 
input. However, we will show in Section 3, that this difference only plays a minor role in the 
context of approximability. 

Norms. Throughout this paper, we will restrict ourselves to the norms fulfilling the following 

two properties. We call a norm ||-|| monotone if y' < y" implies ||y'|| < ||y"|| for any y' , y" E lEl>o- 

We call a norm ||-|| polynomially decidable, if we can decide whether ||y'|| < \\y"\\ in time 

polynomial in the encoding size of y' and y" . We will mainly use the following families of 

norms: the infinity -norm ||y||oo • — max^ \yi\ (which we will sometimes also denote by ((y))oo 

i_ 

for convenience), the standard ^^-norm ||y||p := (X^j |y«|^)''! and the cornered p-norm {{y))p := 
maxj + ^Y^i\yi\- The motivation for the cornered norm is twofold. Firstly, for general 
values of p it will be hard to minimize a distance measured in the ^^-norm because of the 
exponents. The cornered p-norms are simpler, but still have properties similar to the £^-norms: 
Their unit spheres are nested within each other, and for increasing values of p they approach 
the axis parallel square. This allows to control the degree of balancing of the criteria in the 
reference point solution. Secondly, the infinity-norm (often referred to as Chebyshev-norm in 
this context) is very popular in MCDM-tools. Often it is augmented by a small linear term to 
avoid weakly Pareto optimal solutions (cf. [5]), similar to the addition of the term |||y||p. 
Note that all and cornered p-norms are monotone and polynomially decidable. 

Approximation of the Pareto Set. We extend the well-known concept of approximation 
algorithms for the single-objective case to approximability of the Pareto set in a similar way 
as done in [16], with the slight difference of considering minimization problems and including 
constant factor approximations. For a > 1, an a-approximate Pareto set is a set ya Q y such 
that for all y £ yp there is y' G ya with y' < ay. An a- approximation algorithm for the 
Pareto set is an algorithm that constructs an a-approximate Pareto set in polynomial time, 
and an FPTAS for the Pareto set is a family of algorithms that contains for all e > a (1 + e)- 
approximation algorithm for the Pareto set with running time polynomial in ^ and the size of 
the instance of V. 

3 Equivalence of Approximation 

In this section, we investigate the relation between approximation of the Pareto set, reference 
point methods, and compromise programming. Our main theorem states these three notions of 
approximability are essentially equivalent. 

Theorem 3.1. Let V be a multicriteria discrete minimization problem. The following state- 
ments are equivalent. 

• There is a constant factor approximation (FPTAS, respectively) for the Pareto set ofV. 

• There is a constant factor approximation (FPTAS, respectively) for RP('P, ||-||) for every 
monotone and polynomially decidable norm \\-\\. 

• There is a constant factor approximation (FPTAS, respectively) /or R.P(7^, ||*||oo)' 

• There is a family of algorithms that, for each p > 1, contains a constant factor approx- 
imation (FPTAS, respectively) for RP('P, ||-||p) or RP(7^, ((•))p), and the running time of 
all algorithms is bounded by a polynomial in the input size and log(p). 

• There is a constant factor approximation (FPTAS, respectively) for CP^V, ||-||) for every 
monotone and polynomially decidable norm \\-\\. 
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• There is (I coTistdTit fcictoT appToxiTnatioTL vespectively) for CP(7^, ||*||oo)' 

• There is a family of algorithms that, for each p > 1, contains a constant factor approx- 
imation (FPTAS, respectively) for CP('P, ||-||p) or CP('P, ((•))p), and the running time of 
all algorithms is hounded by a polynomial in the input size and log(p). 

Before we discuss the proof of Theorem 3.1 in detail, we turn our attention to a result of 
independent interest that motivates the algorithmic use of the i^- and cornered p-norms. 



Reference Point Solutions and the Pareto Set. Gearhardt [8] showed that for both the 
IP-norm and the cornered p-norm, if p tends to infinity then the distance between the Pareto set 
and the set of compromise solutions with respect to ah non-negative normalized weight vectors 
tends to zero. This means that for discrete optimization problems with a finite set of feasible 
solutions there is a finite value po for which the two sets coincide. We show that under the 
assumption that all objective values have a polynomial encoding (cf. [16]), also p can be chosen 
in such a way that it is polynomially encodable. 

Theorem 3.2. Let y^^ G Z>q he a feasible reference point. If the objective vector set y is 
contained in [0,Af]'^', then the following statements hold true. 

1. If p > Yog{i-^'^ ) ' ^^^^ /^'^ ^^2/ Po-reto optimal solution y £ y there is a weight vector 
A G Q>o such that y minimizes \\y — y^^Wp- 

2. If p > kM , then for any Pareto optimal solution y € y there is a weight vector A G Q>o 
such that y minimizes {{y — y'^^))p. 

Proof. We first consider the cornered norm {{y))p = maXjgjjt]{Aiyj}-|-^ ^^i^^k] ^iVi- demanded 
in the theorem, let p > kM. Further let y G 3^ be a Pareto optimal cost vector, and let 
I := {i £ [k] : yi = y^^}- We set the weight vector A as follows: 

^ h + k if i G / 
* I — ^-Tp otherwise. 

The weighted distance of y to the reference point is 

{{y - /P))^ = max{A.(y. - y^)} + - A.(y. - y^) = 1 + 1 (fc - |/|) < 1 + ^ . 

ifi p p p 

Consider any y' £ y\ {y}. If there is an index j £ I with y'j > yj = y^ , then since 3^ C 
we know that y'^ — y^ > 1 and therefore 

{{y' - y'n)p > - yf) + 1 Hv'j - ) > (1 + ^) • A, > 1 + A; > 1 + ^ , 

so in this case y is closer to y^^ than y' . 

Otherwise, since y is Pareto optimal there is some j G [k] such that yj < y'j, or with 
integrality y'j — yj > 1. On the other hand, we know that yj — y^ < Af . Therefore for this 
index j, 

Aj(2/j - y/) = Tp = rp = 1 + — rp > 1 + TT ' 

■' Vj - Vj Vj - Vj Vj - Vj M 

and as a consequence 

{{y' - y'^'Vp > max{A.(y^ - )} > 1 + 1, > 1 + ^ , 

2^ rC J.VJ. L) 
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so again y is closer to y'^^ than y' . 

For the ^^-norm we let p > - — , , and set the weight vector A as before. We get 

log(l+Xf) 

(rp \ p 
=k-\I\<k. 

If there is a j G / with y'j > yj = y^, then 
Otherwise, with the same choice of j G [k] as above, 

(l|y' - y'XY > iWj - yJ))' ^ + i^)' > ^ ' 

where the last inequality holds by the choice of p. Thus again in both cases y is closer to y"^^ 
than y', completing the proof. □ 



Prom Approximate Pareto Sets to Approximating Reference Point Solutions. We 

start the proof of Theorem 3.1 by showing that from an a-approximate Pareto set we can always 
choose an a-approximate solution to RP. 

Lemma 3.3. Let y'^^ he a feasible reference point, and let 3^q, he an a-approximate Pareto 
set of V . Then for any monotone norm \\-\\, m.my^y^r{y) < a ■ mmy^yr{y), where r{y) = 
W^ + \\y-yn- 

Proof. Let y* G 3^ be an optimal solution to mmy^y r(y). By monotonicity, we can w.l.o.g. 
assume y* to be Pareto optimal. Thus, there is y' G J^q. such that y' < ay*. Using monotonicity 
and triangle inequality, we get 

y-y'^W < \\a{y*-f^) + {a-l)y^^<a\\y*-y^^ + {a-lW^ . 

Reformulation yields 

min r{y) < r{y') = \m + \\y' - y'^ < a{\\y'P\\ + \\y* - y'^W) = ar{y*) . □ 

Corollary 3.4. If there is an a -approximation algorithm for the Pareto set ofV, then there is 
an a- approximation for RP('P, ||-||) for every monotone and polynomially decidahle norm \\-\\. 

In fact, we can also approximate the compromise solution without knowing the exact ideal 
point: As contains an a-approximate optimal solution for each objective, we can obtain a 
reference point y''? with ^y^'^ < y'^^ < y"^. By choosing the point closest to y'^P from ya we get 
an a^-approximation to the compromise solution: 

Corollary 3.5. If there is an a -approximation algorithm for the Pareto set ofV, then there is 
an a^ -approximation for CP('P, ||-||) for every monotone and polynomially decidahle norm \\-\\. 

Proof. Let ya be an a- approximation to the Pareto set. Observe that 



rp 



— min yj 



yields a feasible reference point with y^'P < y"^ < ay ''P. 

Now let y' := argmin^gj;^ ||y''P|| -|- ||y — y'^Pjl, which by Corollary 3.4 is an a-approximation 
to the reference point solution for y''P. Thus, for the compromise solution y*, we get 

||y'-/P||<a||y*-y>^P|| + (a-l)||y-^P||. 
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By this fact and monotonicity, we get 

\\y' - y'^W < \\y' - y'^ < a\\y* - /p|| + (a - l)||y'^P|| . 
Observe that y^'^ — y^^ < (a — 1)?/'^^ and thus, again by monotonicity 

\\y*-y'''\\<\\y*-y'^ + ia-iW^\\. 

This finaUy yields, 

lly^'^ll + \\y' - y'^W < W^W + a{\\y* - /p|| + (a - 1)||/P||) + {a- 

which concludes the proof. □ 

Prom Approximating a Reference Point to an Approximate Pareto Set. In order to 
show the converse of the result proven above, we use a characterization from [16], stating that 
approximability of the Pareto set is equivalent to tractability of the so-called Gap problem. 

Definition 3.6 (Gap Problem). Given an instance of V and a vector y G Q>o input, the 
Gap problem for approximation factor a > 1, denoted by Gap('P, a), is to find a solution y' 
with y' < y or to guarantee that there is no solution y" G y with y" < ^ y. 

Theorem 3.7 (Papadimitriou & Yannakakis, 2000). Let V be a multicriteria discrete mini- 
mization problem and let a > 1. If there is an a -approximation algorithm for the Pareto set, 
then GAp(7^,a) is solvable in polynomial time. If Gap{V, a) is solvable in polynomial time, 
then there is an a'^ -approximation algorithm for the Pareto set. 

We now show how to use an approximation algorithm for RP to solve the Gap problem 
with a slight increase in the approximation factor. In fact, our result does not even require the 
algorithm to solve RP for every given reference point. It suffices to find a particular reference 
point on an instance-by-instance basis that can be approximated. We formalize this by intro- 
ducing two algorithms, the first acting as an oracle computing a suitable reference point, which 
then can be approximated by the second algorithm.^ 

2 

Lemma 3.8. Let a > 1 and set j3 := 2a~i ■ There is a polynomial time algorithm for GAP {V , a) , 
if there are two polynomial time algorithms Ai , A2 such that, 

• given an instance of V, algorithm Ai computes a feasible reference point y^^ S Q>o for 
that instance, and, 

• additionally given y^^ and A S Q>o, algorithm A2 computes in polynomial time a solution 

rpll-^ _|_ |U,rP _ ^11-^ 



y' &y with r{y') < P miriz^y r{z) for r{z) = ||y''P||oo + Wy^"^ ~ ^ 



1 00 ■ 



Proof. Let y G (Q>o be the input to the Gap problem. W.l.o.g., we can assume that y > ay'^^ 
for the reference point y''P computed by Ai, as otherwise there is no y' < ^y and Gap can be 
answered negatively. 

We will solve the Gap problem with a single call of the /3-approximation algorithm for 
KP{V, IHloo)- For i G [A;], let Aj := ^ _^^rp if yi > y^^ and Aj := 2 if yj = y[P = 0, and let y' be a 
/3-approximation to miiizizy r{z). 



^Note that it is not sufHcient for the first algorithm to simply return a trivial feasible reference point such as 
0, as it has to ensure that the second algorithm can provide an approximation for this point. E.g., in the proof 
of Corollary 3.9, it needs to return a point close to the ideal point. 
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If r{y') < r{y), we return y' as answer to the Gap problem: 

Kiy'^-y7)<\\y-y'''\t<\\y-y'''\t<'^ 

for all i G [k] by choice of the weights. Dividing by A, yields y^ < yi ii yi > or y'^ < ^ if yi = 0. 
In the latter case, integrality of y- implies y- = 0. 

If r{y') > r{y), we answer Gap negatively: Let y" G 3^. We show that there is an i G [k] 
with 2/" > ^yi. First observe that (3r{y") > r{y') > r{y), which implies 

/3||y"-y^P||^>l|y-y^P||^-(/3-i)||y^P||^. 

Plugging in the definition of the weights and using y > ay"^^ yields 

^ > ^ _ (;3 - 1 ) ^ > 1 - 14 , 

with being the indices of those components attaining the maxima in the norms. (If either 

of the denominators is then y'-' > ^yi follows directly.) Using the fact that 1 < /? < a, we get 

(^y^ > (1 - ^l)(y^ - yf) + f^vT > (i - l^i)y^ ■ 

It is easy to verify that /? = 2a-i implies y" > -^yi and the negative answer to the Gap 
problem is correct. □ 

As a particular application of Lemma 3.8 we can show now that also an approximation to 
CP suffices to approximate the Pareto set: 



Corollary 3.9. Let a > 1 and set /3 := y 2a-i • There is a polynomial time algorithm for 
GAp{V,a), if there is a P- approximation algorithm for CP(T^, ||"||oo)- 

Proof. We show that algorithm Ai and A2 exist, as required by Lemma 3.8. 

Algorithm Ai: For every i G [A;], let y*-*^ be a /3-approximation to min^gy r^id xi^) ^or weights 

Aj = 1 and Xj = for j G [k] \ {i}. Then := ^yj*^ defines a feasible reference point with 

Algorithm A2: Let A G Q'^. Let y' be a /3- approximation to miuz^y ryid x{z), and let 
y* = argmin^g-y Tj^rp ;^(2;) be an optimal solution to RP. We show that ryip \{y') < (3'^ryrp x{y*), 
which concludes the proof. 

ll/P||oo + \\y' - y'^oo < ||/P||oo + \\y' - y'lU + y - y'^oo < m^o. + \\y' - y'lU 
</3||2/^P||oo + /3||y*-y'1loo + (/3-i)||2/^'^||oo 
</3'l|y''P||oo + /3||y*-y'1loo. □ 

Corresponding versions of Lemma 3.8 and Corollary 3.9 with the same approximation factors 
can be shown for the and ((•))p-norms. These results have been moved to the appendix. 



4 Approximating Reference Point Solutions 

Approximation by Weighted Sum. Although not all Pareto optimal solutions can be 
reached by minimizing a weighted sum, this method still provides an easy way to transfer 
approximability results from the single-criterion world to reference point methods. 

Theorem 4.1. If there is an a -approximation forminy^y X^y, then there is a ka- approximation 
for RP(P,|HU). 
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Proof. Let ?/''p be a feasible reference point and A G Q>o- Let y* 
y' £ y he an a-approximation to miny^y X'^y. Then 

,rp II A 

cx 

<Mlly'^'^ll^ + l|y 

In combination with Theorem 3.1, this imphes the following result 



argminr„rp and let 



< lly'-PII^ + akX'^iy* - y'^ + (« " l)kX'^y''' 

y'^'lt) ■ 



□ 



Corollary 4.2. For any multicriteria combinatorial minimization problem V with a constant 
number of linear objectives, there is a constant factor approximation for the Pareto set of V if 
and only if there is a constant factor approximation for the single- criterion version ofV. 



Convex Optimization with Linear Objectives. For optimization problems where the 
solution space is convex and the objectives are linear (e.g. linear programming), we can compute 
reference point solutions w.r.t. the cornered norm exactly: 

Theorem 4.3 (Reference Point Solutions for Convex Optimization). For a multicriteria min- 
imization problem min^g/^" Cx with a convex solution set X C Q" for which a polynomial 
separation algorithm exists, and a cost matrix C G Q^^", the problem minx^x f{Cx) with 
'"(y) — {{y'^^))p + {{y ~ y^^Jlv f^''" ^'^y feasible reference point y'^^ and any p G [l,oo], is again a 
convex optimization problem with linear objectives and thus solvable in polynomial time. 

Proof. The problem can be formulated as follows: 

min A + I • I'^Cx 

„rp|| j_ J s.t. Cx-y'T <A-1 
x £ X 
A G E, . 



minr(Cx) = ||y^^||oo + { 



Here 1 denotes the vector of ones of corresponding dimension. Li the optimum A = maxjjcj.x — 
yl"^}, and therefore the two programs are equivalent. The objective is clearly linear, and the 
solution space is x IR intersected with the halfspaces defined by the inequalities q.x — < A, 
i £ [k], and thus convex. 

Since we can solve the separation problem for the original set X, we can also solve it for the 
set with the added inequalities. By the equivalence of separation and optimization (cf. [9]) we 
can solve minx^x fiCx) in polynomial time. □ 



Remark. A special case of convex optimization problems are linear programs (LPs). From 
our result it follows that we can exactly compute reference point solutions for multicriteria LPs. 
It also yields a nice alternative proof of the existence of an FPTAS for the Pareto set, which 
has first been proven in [16] using an involved geometric argument. 

A different argument for the approximability of Pareto sets of linear programs has indepen- 
dently been noted by Mittal and Schulz [13]. They use it to approximately optimize low-rank 
functions over polytopes. 

Corollary 4.4. Let V be a multicriteria minimization problem with convex feasible set and 
linear objective functions. Assume there is a positive polynomial it such that 3^ C G Q*^ : yi > 
^(^^-j yi G [k]}, where \I\ is the encoding length of the instance. If there is a polynomial time 
algorithm for the separation problem ofV, then there is an FPTAS for the Pareto set. 
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Remark (Convex sets and the integrality assumption). Note that our general integrality as- 
sumption y C Z>Q for discrete optimization problems introduced in Section 2 does not hold 
for the case of convex optimization problems in Theorem 4.3 and Corollary 4.4. However, by 
assuming yi > ^(^j^^ for all occurring objective values in Corollary 4.4, we ensure that all pre- 
requisites stated in [16] for Theorem 3.7 are still fulfilled. Furthermore observe that, while 
our proof of Lemma 3.8 also assumed integral objectives, we used this integrality assumption 
only for showing that if the solution y' computed by algorithm A2 fulfills r{y') < r(y) then 
yi = implies y- = 0. However, we can ignore this case, as by our assumption all objectives 
are strictly positive and thus yi = already implies that the answer to Gap is negative. Thus, 
both Lemma 3.8 and Theorem 3.7 are still valid for convex optimization problems fulfilling the 
condition of Corollary 4.4. 

Proof of Corollary 4-4- By Theorem 4.3, we can compute an optimal solution to RP(7^, ||-||oo) 
for any reference point in polynomial time. Thus, by Lemma 3.8 we can solve Gap(V, 1 + e) 
in polynomial time for any e > (with running time independent of e), which by Theorem 3.7 
gives an FPTAS for the Pareto set. □ 



Approximation through LP Rounding. One of the most successful techniques for the 
design of approximation algorithms for integer problems is LP rounding: The problem is for- 
mulated as a linear integer program (IP), then the integrality constraints are relaxed and the 
resulting LP is solved, and finally the optimal fractional solution is rounded to a feasible integral 
solution, losing only a certain factor in the objective. 

We show that these algorithms can be adapted such that they also approximate the reference 
point version of the problem with the same approximation factor. 



Theorem 4.5. Consider a multicriteria minimization problem vainx^x Cx with a solution set 

n 

>0 



X ^ S>o "'''T'd a, cost matrix C € Q^^". // there exist 



• a convex relaxation X' for which the separation problem can be solved in polynomial time, 
and 

• a polynomial time rounding procedure IZ : X' ^ X such that for all c E Q>o 
x' G X' it holds that c^lZ{x') < ac^x', 

then for any feasible reference point y^^ and any p G [1, 00] there is a a- approximation algorithm 
for mSn^^zx r{Cx) with r{y) = {{y^^))p + {{y - y'^))p- 

Proof. From Theorem 4.3 it follows that we can compute in polynomial time a fractional solution 
x' G X' minimizing r{Cx). Let x = TZ{x'). Then 

r{Cx) = max{y'P} + max{(Cx)i - y]^} + - ■ ^(Cx)i 

< max{yl^} + max{a(Ca;')j - yl^} + a ■- ■ y^{Cx')i 

iG[fc] iG[fc] p ^ 

= max{y'P} max {a((Cx')i - yf) + (a - V)yf] a • - • V (Cx')i 

iGfc iGfc p '-f 

%<^\k\ 

< a ■ maxjyj^''} -|- a ■ max{(Cx')j — yl^\ + a ■ - ■ {Cx')i 

i€[k] ie[k] p ^ 

«G[fcJ 

= a ■ r{Cx') . □ 
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This immediately results in the approximability, (with a factor independent of A;,) of reference 
point solutions and the Pareto set for several classical combinatorial optimization problems. We 
give two examples here. 

For Set Cover, in 1982 Hochbaum [12] presented an LP-based ^-approximation algorithm, 
where k is the maximum cardinality of a set, thus there is a k- approximation algorithm for the 
corresponding reference point version and a 0(K^)-approximation algorithm for the Pareto set. 
A notable special case is Vertex Cover, where k = 2. 

For the scheduling problem of minimizing the weighted sum of completion times on a single 
machine with release dates {MfjlY^WjCj) Hall et al. [10] gave a 3-approximation algorithm 
based on an LP-relaxation, resulting in a 3-approximation for compromise solutions, which 
gives a constant factor approximation for the Pareto set as well. Mohring et al. [14] extended 
this to stochastic scheduling with random processing times {P\pj ^ stoch, rj\E[^WjCj]), for 
which we consequently also get constant factor approximation for the multicriteria problems. 



Remark. While we usually restrict ourselves to the case of a constant number of criteria, the 
results on convex optimization and LP-rounding also hold for a polynomial number of criteria. 
This is due to the fact that we can still solve the linear program if we add a polynomial number 
of constraints. 



From Pseudopolynomial Algorithms to Approximation Schemes. Multicriteria op- 
timization and in particular the concept of compromise solutions is closely related to robust 
optimization. If each criterion is considered as one scenario in the robust setting, then a com- 
promise solution w.r.t. ||-||oo is exactly the same as a min-max regret robust solution. 

Aissi et al. [1] consider this robust setting and show that if upper and lower bounds on the 
optimum can be computed that only differ by a polynomial factor, and if there is a pseudopoly- 
nomial algorithm whose running time depends on the size of the instance and the upper bound, 
then there is an FPTAS for the min-max regret robust problem. We show that this result can 
be extended to reference point solutions. 



Theorem 4.6. Consider a multicriteria minimization problem with a set of feasible solutions 

ykXT 

-'>o 



X C {0, 1}" and cost matrix C G Z>g". For any p G [l,co], if 



1. for any instance I = {X,C), and any feasible reference point y^'P, a lower and an upper 
bound L andU on miiix^x i"{Cx) can be computed in time 7ri(|/|), such that U < tt2{\I\)L, 
where tti and 1^2 are non- decreasing polynomials, 

2. and there exists an algorithm that solves m.va.x(^x "riCx) for any instance I = {X,C) in 
time 'K^{\I\,U), where 713 is a non- decreasing polynomial, 

then there is an FPTAS for m.m.x<^x '''{Cx), where r{y) = {{y'^^))p + {{y — y^^))p- 

By |/| we denote the encoding length of the instance /. 

Proof. To compute a (l+e)-approximation to the reference point solution, we set e' = e(l + |)~^ 
and apply the pseudopolynomial algorithm to a modified instance I with cost coefficients Cij := 
Llx J • Then 

e^L _ 

3n ■ - ^ 3n ^ ' ' 

The reference point for the modified instance is defined by if^ := y^J . This reference point 
is feasible for the modified instance, and it holds that 

3n ^' - 3n 3n 3n 3 ^ ' 
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Let X* and x* be reference point solutions for / and /, respectively. We now bound the 
value of X* w.r.t. the original costs c. Let r and r denote the relative distance for the original 
and the modified costs, respectively. We get 



= r(Cx*) +eL 
< (l + e)r(C7x*) . 

It remains to be shown that x* can be computed in time polynomial in |/| and ^. For this, 
denote by L and U the lower and upper bounds on the optimal value OPT of the modified 
instance /. According to the requirements of the theorem we can compute L and then x* in 
time 

7ri(|/|) +7r3(|7|,I7) < vridll) + 7r3(|7|, 7r2(|7|)I) 



<7ri(|I|)+7r3(|/|,7r2(|/|)OPT) 

< vri(|/|) + vra (|7|, vr^d/DO^d/l) + n(l + f ) 



where the last inequality holds because 



OPT < ^{{f^h + %{{Cx* - y'^h + ^(l + ^ 

3n / k 

< — - U + n(l + - 
e'L \ p 



< |. .2(1/1) +n(l + ^) 



Finally note that |/| < 7r4(|/|, log -, log -) for some polynomial tt^, thus the above calculations 
prove that the running time is indeed polynomial. 

For compromise solutions, we can not choose the reference point of the modified instance as 
we see fit. However, also for the ideal point eq. (1) still holds. To see this, denote the respective 
ideal points by y"^ and y^*^ and let for i G [k] be optimal solutions of minxizx CiX and 

mm^fz^CiX. 

It holds that 

yf = Qx(^) > > — Cix(^) = —yf , 



yf = c^^O-) < £j^(c, + < ^c,x(^-) + — < —yf + — , 

- 3n ^ ^ - 3n 3 " 3n 3 

so eq. (1) also holds for the ideal points and the rest of the proof works as before. □ 
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Remark. For the running time it is essential that p is fixed or at least bounded from below by 
a positive constant (e.g. p > 1), as the running time is only polynomial in ^. Since for p — )• 
compromise solutions at some point is equivalent to the weighted sum technique this is only a 
minor restriction. 

Remark. Theorem 4.6 also holds for CP(7^, ((•))p). 

Similarly to Proposition 1 in [1], we can show that the necessary bounds U and L can 
be computed if the single-objective problem is tractable. This is a direct implication of the 
weighted sum approximation described in Theorem 4.1. 

Corollary 4.7. // there is an a -approximation for the single- criterion version ofV, then for 
all instances ofKPiV, ||-||) we can compute L such that L < mmy(zy r(y) < akL. 

The pseudopolynomial algorithms for the shortest path problem (SP) and the minimum 
spanning tree problem (MST) presented in [1] can be used to compute reference point solutions 
as well, as they both compute all (non-dominated) regret vectors (that obey the upper bound 
U), and the reference point solution always has a non-dominated regret vector. 

Corollary 4.8. There is an FPTAS for RP(SP, ((•))p) and RP(MST, ((•))p) for any p G [l,oo]. 

5 Conclusion 

Reference point methods are a popular tool of practitioners in multicriteria optimization. To 
the best of our knowledge, this paper provides the first extensive theoretical study of these 
methods in the context of approximability. 

Our main result gives a new twist to approximation in multicriteria optimization: We show 
that the approximability of the Pareto set of a mw/iicriteria problem can in fact be reduced 
to the approximation of a single objective, namely the relative distance to a feasible reference 
point. We believe that this insight can spark off new and interesting research in this field. The 
applicability of the presented methods is supported by several examples, such as the approxi- 
mation of reference point solutions through LP rounding or dynamic programming. 

Acknowledgment. The authors would like to thank Giinter Ziegler for his help in simplifying 
the proof of Lemma 3.3. 
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Appendix 

2 

Lemma (3.8 revisited, for {{■))p and ||-||p). Let a > 1 and set (3 := 2a-i ■ 'L'here is a polynomial 
time algorithm for GAp{'P,a), if there are two polynomial time algorithms Ai,A2 such that, 



given an instance of V , algorithm Ai computes in polynomial time a feasible reference 

k 

>o 



point y^'P G Q>o for that instance, and. 



• additionally given y^^ and A G Q>o '^'^^ P > 1, algorithm A2 computes in polynomial 
time a solution y' € y with r{y') < /3 min^gj; r(z) for r{z) = {{y'^^))p + {{y'^^ — z))p or 
r{z) = Wy'^^Wp + \\y^^ — z\\p, respectively. 

Proof. Let y G Q>o be the input to the Gap problem. W.l.o.g., we can assume that y > ay^^ 
for the reference point y^^ computed by Ai, as otherwise there is no y' < and Gap can 
answered negatively. 

We will solve the Gap problem with a single call of the /3-approximation algorithm for 
RP(P, ((•))p) (or RP(P, II -lip), respectively) with 

p := max \ - — ^ . , 2kMq \ , 

where q is the largest denominator of all the components in y and M is an upper bound on the 
objectives in y. 

f2 ifiG/ 

Let / := {i G [k] : yi = y^ = 0}. For i G [k], Ai = < 



Tp- otherwise. 



Let y' be a /3-approximation to xa.va.z&y r{z). 
If r{y') < r{y), we return y' as answer to the Gap problem: We observe 



Hvi - y?) < {{y' - < {{y - y^^))^ < 1 + | • 

If i G I, we have y[ < i(l + jm^) < 1. If i ^ /, then < (1 + < y^ + ^ < + 1. In both 

cases, integrality of y' implies y^ < y^. The same holds for the || -Hp-norm with 1 + | replaced 

by — in this case, the choice of p guarantees • y- < y - + 1. 

If r(y') > r(y), we answer Gap negatively: Let y" G y. We show that there is an i G [k] 
with y-' > —yi. This is true if y > = yi for any i £ I. Thus, we can restrict to the 
projection of to the components in [k] \ I, and w.l.o.g. assume I = %. First observe that 
f3r{y") > r[y') > r{y), which implies 

Hy" - y'X > ((y - - (/^ - My'X ■ 

It is easy to verify that {{z))^ < (1 + |)||2;||;^ for all z G Q'', and furthermore {{y-y^^))p = 1 + | 
as / = 0. This yields 



(1 + ^)/3||y" - y^P||^ > (1 + ^)||y - y^P||^ - (1 + ^)(/3 _ 1)||/p||A 



00 ) 



which brings us back to the case of the ||-|| co-norm. The same holds true for the ||-||p-norm with 
the factor 1 + | replaced by □ 



Corollary (3.9 revisited, for ((•))p and ||-||p). Let a > 1 and set /3 := y 2a-i ■ L'here is a poly- 
nomial time algorithm for Gap(7^, a), if there is a j3- approximation algorithm for CP('P, ((•))p) 
(CP{V, IHIp); respectively) for every p > 1 and the running time of all algorithms is hounded by 
a polynomial in the instance size and \og{p). 

Proof. The proof is identical to that of Corollary 3.9 given in the paper. In fact, the second 
part of this proof only uses properties of monotone norms. □ 
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